Appendix A. Accompanying Application Document and CD 



1. Two CD's Labeled "Document, Sample Implementation" 

A. The disks contain only three ASCII files. 

B. Each disk in the duplicate set is identical. 

C. Contents of the CD: 

File Name Type Size Date Description 

ABM4 9 TXT 156,256 05-16-02 Detailed description of ImageFinder 4.9 
ABM5_0 TXT 96,515 05-16-02 Detailed description of PolyApplet 5.0 
ABM5_1 TXT 43,019 05-16-02 Detailed description of Trans Applet 5.1 

D. These documents are Copyrighted: 

ImageFinder 4.9: TX 5-385-330 
PolyApplet 5.0: Pending 
TransApplet 5.1: Pending 

E. Interpretation: These three files will give detailed descriptions of the three sample 
implementations: 

Detailed description of ImageFinder 4.9 
Detailed description of PolyApplet 5.0 
Detailed description of TransApplet 5.1 

2. Two copies of the coil bound manual labeled "User's Guide, Attrasoft ImageFinder 4.9". 
These are two hard copies of the User's Guide for Attrasoft ImageFinder 4.9. 

3. Two CD's Labeled "Attrasoft ImageFinder 4.9" 

A. The disks contain only non-ASCII files. The CD contains two types of files: 
(Al) Installation file, which will install the following executable files to a computer with 
Microsoft Windows as the operating system: 

• Attrasoft ImageFinder 4.9 for Windows 95/98/ME, execution files; 

• Attrasoft ImageFinder 4.9 for Windows 2000/XP, execution files; 
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• Data File for running the software; 

• User's Guide in Microsoft Word, and 

• User's Guide in html format. 

(A2) A set of executable files running from the CD with Microsoft Windows as the operating 

system: 

• Attrasoft ImageFinder 4.9 for Windows 95/98/ME, execution files; 

• Attrasoft ImageFinder 4.9 for Windows 2000/XP, execution files; 

• Data File for running the software; 

• User's Guide in Microsoft Word, and 

• User's Guide in html format. 

B. The Operating System is Windows 95, 98, ME, 2000, and XP. 

C. Each disk in the duplicate set is identical. 

D. Contents of the CD: 

Not all contents are listed, because there are too many files. The two data directories, for 
example, contain more than 80,000 files. The Date information is not accurate due to the date 
setting of the computer, which creates these files. 



Root Directory Contents: 
File Name Type 


Size 


Date 


Description 


DISK1 


ID 


5 


01-05-90 9:31p 


Installation File 


DISK10 


ID 


5 


01-05-90 9:31p 


Installation File 


DISK11 


ID 


5 


01-05-90 9:31p 


Installation File 


DISK12 


ID 


5 


01-05-90 9:31p 


Installation File 


DISK13 


ID 


5 


01-05-90 9:32p 


Installation File 


DISK14 


ID 


5 


01-05-90 9:32p 


Installation File 


DISK2 


ID 


5 


01-05-90 9:32p 


Installation File 


DISK3 


ID 


5 


01-05-90 9:32p 


Installation File 


DISK4 


ID 


5 


01-05-90 9:33p 


Installation File 


DISK5 


ID 


5 


01-05-90 9:33p 


Installation File 


DISK6 


ID 


5 


01-05-90 9:33p 


Installation File 


DISK7 


ID 


5 


01-05-90 9:33p 


Installation File 
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DISK8 


ID 


5 


01-05-90 9:34p 


Installation File 


DISK9 


ID 


5 


01-05-90 9:34p 


Installation File 


SETUP 


EXE 


47,616 


01-05-90 9:3 lp 


Installation File 


SETUP 


INI 


32 


01-05-90 9:31p 


Installation File 


SETUP 


INS 


147,449 


01-05-90 9:3 lp 


Installation File 


SETUP 


ISS 


510 


01-05-90 9:3 lp 


Installation File 


SETUP 


PKG 


15,061 


01-05-90 9:3 lp 


Installation File 


INST32I 


EX_ 


306,666 


01-05-90 9:3 lp 


Installation File 


ISDEL 


EXE 


8,192 


01-05-90 9:3 lp 


Installation File 


_SETUP 


1 


721,623 


01-05-90 9:3 lp 


Installation File 


_SETUP 


10 


1,454,681 


01-05-90 9:3 lp 


Installation File 


_SETUP 


11 


1,455,574 


01-05-90 9:3 lp 


Installation File 


SETUP 


12 


1,455,468 


01-05-90 9:3 lp 


Installation File 


SETUP 


13 


1,454,113 


01-05-90 9:32p 


Installation File 


SETUP 


14 


1,074,165 


01-05-90 9:32p 


Installation File 


_SETUP 


2 


1,454,796 


01-05-90 9:32p 


Installation File 


_SETUP 


3 


1,456,887 


01-05-90 9:32p 


Installation File 


SETUP 


4 


1,455,245 


01-05-90 9:33p 


Installation File 


SETUP 


5 


1,455,918 


01-05-90 9:33p 


Installation File 


SETUP 


6 


1,455,206 


01-05-90 9:33p 


Installation File 


SETUP 


7 


1,453,720 


01-05-90 9:33p 


Installation File 


SETUP 


8 


1,455,603 


01-05-90 9:34p 


Installation File 


SETUP 


9 


1,456,571 


01-05-90 9:34p 


Installation File 


_SETUP 


DLL 


10,752 


01-05-90 9:3 lp 


Installation File 


cpTTTP 
1 Ur 


LIB 


196,219 


01-05-90 9 3 Id 


Installation File 


ABM49 


<DIR> 


06-08-01 l:04p 


Executable File 


USPT072 


<DIR> 


02-28-01 7:15p 


Data File 


USPT074 


<DIR> 


05-21-01 4:33p 


Data File 



E. Interpretation of the files 

(El) Files labeled "Installation File" are used to install the following executable files to a 
computer with Microsoft Windows as the operating system: 



63 



• Attrasoft ImageFinder 4.9 for Windows 95/98/ME, execution files; 

• Attrasoft ImageFinder 4.9 for Windows 2000/XP, execution files; 

• Data File for running the software; 

• User's Guide in Microsoft Word, and 

• User's Guide in html format. 

To install the software to a Personal Computer using Windows, double click the setup.exe 
file. 

(E2) The directories, labeled "Data", contain the data files to run the software. There are more 
than 80,000 files in the two directories, so they will not be listed. 

(E3) The directories, labeled "Executable", contain the executable file to run from the CD. 
Directory Contents: 



File Name 


Type 


oize 


Date Description 


50X50 


<DIR> 




06-08-01 l:04p 


Data File 


ABM49_2K EXE 




06-08-01 11:54a 


Executable 


ABM_A1 


BMP 


ZOjloZ 


08-31-99 ll:02p 


Executable 


DEISL1 


ISU 


H /,UjO 


06-08-01 1-05n 


pYPrutflhle 


LMAGEF-7 <DIR> 




06-08-01 l:04p 


Data File 


ISREG32 


DLL 


24,576 


02-07-96 8:07a 


Executable 


ABM48 


TXT 


79 


06-08-01 12:26p 


Executable 


ABM48J 


TXT 


6 


03-23-01 9:20a 


Executable 


ABM48_2 


TXT 


6 


03-23-01 9:21a 


Executable 


ABM48_3 


TXT 


6 


03-23-01 9:21a 


Executable 


ABM48_4 


TXT 


6 


03-13-01 2:28p 


Executable 


ABM48_5 


TXT 


6 


03-13-01 2:28p 


Executable 


ABM48_6 


TXT 


6 


03-13-01 2:28p 


Executable 


ABM48_7 


TXT 


6 


03-13-01 2:28p 


Executable 


ABM48_8 


TXT 


6 


03-13-01 2:29p 


Executable 


ABM48_9 


TXT 


6 


03-13-01 2:29p 


Executable 


ABM49 


EXE 


386,048 


06-08-01 10:53a 


Executable 


ABM4_9 


DOC 


3,598,336 


06-07-01 10:52a 


User's Guide, Word 


FBI 


<DIR> 




06-08-01 l:04p 


Data File 
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FINAL 

HELP 

L0CK_~15 

L0CK_~17 

NOTES 

OBLIQUE 

STAMP 

USPTO 



<DIR> 

<DIR> 

<DIR> 

<DIR> 

TXT 

<DIR> 

<DIR> 

<DIR> 
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06-08-01 l:04p 
06-08-01 l:04p 
6-08-01 l:04p 
06-08-01 l:04p 
03-23-01 10:33a 
06-08-01 l:04p 
06-08-01 l:04p 
06-08-01 l:04p 



Data File 

User's Guide, html 
Data File 
Data File 
Executable 
Data File 
Data File 
Data File 



The interpretation of this subdirectory: 

• The directories, labeled "Data", contain the data files to run the software. 

• The directory, labeled "User's Guide, html", contains the user's guide files in html 
format. 

• The file, labeled "User's Guide, Word", contains the user's guide files in html format. 

• The files, labeled "Executable", contain the executable files for Windows 
95/98/ME/200/XP. 

4. Two copies of the coil bound manual labeled "User's Guide, Attrasoft TransApplet 5.1" 
These are two hard copies of the User's Guide for Attrasoft TransApplet 5.1. 

5. Two CD's Labeled "Attrasoft TransApplet 5.1" 

A. The disks contain only non-ASCII files. The CD contains the following files: 

• Attrasoft TransApplet 5.1 software library for Windows 95/98/ME/2000/XP, 
COM/DLL file format; 

• Sample Implementation Codes; 

• User's Guide in Microsoft Word, and 

• User's Guide in html format. 

B. The Operating System is Windows 95, 98, ME, 2000, and XP. 

C. Each disk in the duplicate set is identical. 

D. Contents of the CD: 
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Root Directory Contents: 



rue iName 


Type 




X-/O.IC/ 


Description 


ABM5 1 


DOC 


616,448 


10-21-01 11:28a 


User's Guide, Word 


CHAP3 


<DIR> 




10-19-01 4:31p 


Examples 


CHAP4 


<DIR> 




10-19-01 4:31p 


Examples 


CHAP5 


<DIR> 




10-19-01 4:31p 


Examples 


CHAP6 


<DIR> 




10-19-01 4:31p 


Examples 


CHAP7 


<DIR> 




10-19-01 4:32p 


Examples 


FBI 


<DIR> 




06-08-01 l:04p 


Examples 


HELP 


<DIR> 




10-19-01 4:40p 


User's Guide, Word 


OBLIQUE 


<DIR> 




06-08-01 l:04p 


Examples 


README 


TXT 


567 


10-20-01 10:51a 


readme.txt 


TRANS-26 


DLL 


282,112 


0-21-01 11:00a 


COM DLL 



E. Interpretation of the files 

(El) The file labeled "COM DLL" is the COM DLL software library file to be used by users. 
(E2) The directories, labeled "Examples", contain the examples of how to use the COM DLL. 
(E3) The files, labeled "User's Guide, Word" and the directory, "User's Guide, html", contain 
the User's Guide. 

6. Inventor's Resume'. 
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Annotated 



Application Layer 



I 



Presentation Layer 


A 


r y 


i 
r 


APN 




ABM 



Figure 2. 3-Layer Architecture for software implantation of the Present 
Invention. 
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Annotated 




D:Welib\fbi\G'ODMWlA.JPG,24192 
D:\imageEb\fbi\GQDWTN2A;jPG 30400 
D:\jmafieEb\fbi\G6DWIN2C.JPG28928 
D;Welib\fbi\G6^^ 
D:\ima£ehb\fbi\GdDWINC.^IPG 91328 
Di^imageHbVEbftGQDWIND.IPG 4?4:Q4 . 



Images 



Scores 



Figure 5. Sample Search Output of the Present Invention. The search 
output is a list of pairs, or doublets . 

For example, line one of the figure 5 shows a double (image, score), where the image is "D:\... 
GQDWIN1A.JPG". and the score is 24192. 



BEST AVAILABLE COPY 



Annotated 



,<|| C:\bout.htm - Microsoft Internet Explorer ^ BBS ; 




193784 0 0 0 0 0 0 0 0 
Class 0: D:/tock2/50x50/classljp& , 
class2.jpg 

0 32000000 0 ; 0 0. 0 184Q0 0 0 
Glass 1: D :/lock2/5 0x5 0/clas s2.jpg 
class2 l.jpg 

0 13800 0; 0 0 lO; O /O;: ^ 
Class 1: D:/lock2/50z50/class2. jpg 



Figure 6. Sample Classification output of the Present Invention. The 
classification output is a list of triplets. 

The N:N classification is implemented by a set of 1:N searches. Let a and b be two different classes. 
Given an image, x, we can perform a 1:N search for class a. with a triplet (x. a, score-x-a); and a 1:N 
search for class b. with a triplet (x, b, score-x-b). The final answer is fx. score-x-a, score-x-b: maxlscore- 
x-a, score-x-M ). In the above figure, the first line, "classl 9.jpg" is an image, x. The second line has 9 
scores, indicating how likely the image x belongs to any of the 9 classes. Finally, Class 0 is the best match 
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